Early cortical facilitation for emotionally arousing targets during the attentional blink

BACKGROUND: The present study aimed to investigate the time course of electrocortical facilitation for affectively arousing written words during the so-called 'attentional blink' (AB) period in a rapid serial visual presentation (RSVP) task. The AB refers to a period of reduced awareness for second-target stimuli following a first target by an interval of about 200–500 ms. Pleasant, neutral, and unpleasant written verbs were used as second targets in an 8.6-Hz RSVP paradigm that contained affectively neutral words as distractors. Replicating and extending behavioral studies, we expected that emotional second targets would be associated with better identification accuracy and greater electrocortical activity, compared with neutral targets. RESULTS: The steady-state visual evoked potential was recorded using 129 scalp electrodes. The time-varying energy at the presentation frequency of 8.6 Hz was extracted as a continuous measure of electrocortical activity related to the RSVP stream. Behavioral data showed that at an inter-target interval of 232 ms, the report for emotionally arousing (pleasant and unpleasant) words was more accurate than for neutral control words. This result was mirrored by the electrocortical response at posterior sensors, which showed rapid amplitude enhancement (120–270 ms after T2 onset) for pleasant and unpleasant targets specifically. CONCLUSION: The present data suggest that identification facilitation for emotionally arousing target words in the AB is related to rapid enhancement of sensory processing. Affectively arousing information is preferentially selected at the level of early perceptual analysis, leading to facilitation at later stages of processing, including consolidation in working memory and visual awareness

The costs of emotional attention: affective processing inhibits subsequent lexico-semantic analysis

The human brain has evolved to process motivationally relevant information in an optimized manner. The perceptual benefit for emotionally arousing material, termed motivated attention, is indexed by electrocortical amplification at various levels of stimulus analysis. An outstanding issue, particularly on a neuronal level, refers to whether and how perceptual enhancement for arousing signals translates into modified processing of information presented in temporal or spatial proximity to the affective cue. The present studies aimed to examine facilitation and interference effects of task-irrelevant emotional pictures on subsequent word identification. In the context of forced-choice lexical decision tasks, pictures varying in hedonic valence and emotional arousal preceded word/ pseudoword targets. Across measures and experiments, high-arousing compared to low-arousing pictures were associated with impaired processing of word targets. Arousing pleasant and unpleasant pictures prolonged word reaction times irrespective of stimulus-onset asynchrony (80 msec, 200 msec, 440 msec) and salient semantic category differences (e.g., erotica vs. mutilation pictures). On a neuronal level, interference was reflected in reduced N1 responses (204–264 msec) to both target types. Paralleling behavioral effects, suppression of the late positivity (404–704 msec) was more pronounced for word compared to pseudoword targets. Regional source modeling indicated that early reduction effects originated from inhibited cortical activity in posterior areas of the left inferior temporal cortex associated with orthographic processing. Modeling of later reduction effects argues for interference in distributed semantic networks comprising left anterior temporal and parietal sources. Thus, affective processing interferes with subsequent lexico-semantic analysis along the ventral stream

Knowledge Augmented Machine Learning with Applications in Autonomous Driving: A Survey

The existence of representative datasets is a prerequisite of many successful artificial intelligence and machine learning models. However, the subsequent application of these models often involves scenarios that are inadequately represented in the data used for training. The reasons for this are manifold and range from time and cost constraints to ethical considerations. As a consequence, the reliable use of these models, especially in safety-critical applications, is a huge challenge. Leveraging additional, already existing sources of knowledge is key to overcome the limitations of purely data-driven approaches, and eventually to increase the generalization capability of these models. Furthermore, predictions that conform with knowledge are crucial for making trustworthy and safe decisions even in underrepresented scenarios. This work provides an overview of existing techniques and methods in the literature that combine data-based models with existing knowledge. The identified approaches are structured according to the categories integration, extraction and conformity. Special attention is given to applications in the field of autonomous driving

The costs and benefits of processing emotional stimuli during rapid serial visual presentation

Using a dual-target identification task during rapid serial visual presentation (RSVP), we examined facilitation and interference effects exerted by emotional stimuli. Emotionally arousing first targets (T1s) were encoded with higher accuracy than neutral T1s. At the same time, identification of a second neutral target (T2) was impaired reflecting a failure of disengaging attention from arousing T1s. Similar interference was triggered by arousing filler stimuli that were not voluntarily searched for in the RSVP stream (Experiment 2). In Experiment 3, we showed that interference is reduced (though facilitation for arousing T1s is maintained) when the second task itself involves variations in emotional arousal. Vice versa, when arousal associated with the T2 stimulus was predictable, interference recurred (Experiment 4). Our findings indicate that the perceived emotional intensity of a stimulus is a determinant of successful identification during RSVP: Encoding of arousing stimuli is reliably facilitated. Interference effects with subsequent processing arise independently and are strongly modulated by the overall task context and specific processing strategies

Finding McGurk : localisation of the source of the McGurk-effect and related oscillatory sources

The McGurk-effect is a perceptual illusion, which demonstrates an interaction between auditory and visual sensory systems in the perception of speech. If a mismatch between the perception of a sound and the accompanying visual input occurs, it has been observed that the unified perception of both modalities fuses to a novel percept that neither exactly matches the sound nor the sight.A number of studies reported, that this illusion does not appear in every trial, but rather in a proportion of trials (~60-70%). The present study was designed to shed light onto the conditions under which this effect occurs and the identification of cerebral sources associated with it. Specifically, we were interested in the potential influence of ongoing ("background") brain oscillations on varying perception

Prestimulus Oscillatory Brain Activity Influences the Perception of the McGurk Effect

The McGurk effect is a perceptual illusion, which demonstrates an interaction between auditory and vis- ual sensory systems in speech perception. If a mismatch be- tween the perception of a sound and the accompanying visual input occurs, it has been observed that the unified perception of both modalities fuses to a novel percept that neither matches the sound nor the visual stimulus. This effect only appears in 60-80% of trials containing mismatching information. The present study was designed to clarify the conditions under which this effect occurs and to identify cortical sources associ- ated with it. We were interested in the potential influence of induced ongoing brain oscillations associated with varying perception. Our results indicate that the perception of the McGurk effect is associated with higher pre-stimulus beta activity in parietal, frontal, and temporal cortical areas as well as with higher post-stimulus beta activity in parietal cortical areas